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VIRTUAL MACHINE MANAGEMENT USING ACTIVITY 

INFORMATION 



BACKGROUND 



1. Field 



The present disclosure relates to the management of virtual machine(s) using 
information regarding the activity of the virtual machine(s), and, more specifically, to the 
reallocating of resources amongst virtual machine(s) based, at least in part, upon the 
activity of the virtual machine(s). 



2. Background Information 

The virtualization of machine resources has been of significant interest for some 
time; however, with processors becoming more diverse and complex, such as processors 
that are deeply pipelined/super pipelined, hyperthreaded, and processors having 

1 5 Explicitly Parallel Instruction Computing (EPIC) architecture, and with larger instruction 
and data caches, virtualization of machine resources is becoming an even greater interest. 
Some vendors offer software products that permit a machine to be partitioned, such that 
the underlying hardware of the machine appears as one or more independently operating 
virtual machines (VM). Typically, this is achieved by running a thin layer of software 

20 called the Virtual Machine Monitor (VMM) over the hardware which facilities running 
one or more VMs on this layer. The abstraction of a VM is such that the software 
installed inside the VM believes that is has exclusive ownership of the underlying 
hardware. Each VM, on the other hand, may function as a self-contained platform, 
running its own operating system (OS), or a copy of the OS, and/or various software 
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applications. Software executing within a VM is collectively referred to as "guest 
software". 

A typical VMM, which may be considered the controller of the VMs, may 
enhance performance of a VM by permitting direct access to the underlying physical 
5 machine in some situations. This may be especially appropriate when an operation is 
being performed in non-privileged mode in the guest software, which limits access to the 
physical machine or when operations will not make use of hardware resources in the 
physical machine to which the VMM seeks to retain control. The VMM may swap guest 
software state in and out of the processor, devices, memory, and the registers of the 

10 physical machine, while the processor may swap some state in and out during transitions 
between a VM and the VMM. 

The conventional allocation of resources by the VMM to the various VMs relies 
on time-slicing between various VMs according to round-robin or other predetermined 
priority-based schemes. For example, a pre-determined allocated time period (or time 

1 5 quanta) for each VM may be stored in the memory to direct the VMM to periodically 
switch between the VMs based on the previously allocated time period for each VM. 
Round-robin or pre-determined priority-based schemes inherently fail to provide the 
VMM any fine-grain control or authority regarding managing the VMs, as the VMM is 
limited to following the pre-determined plan or scheme. Stated differently, methods, 

20 apparatus, and systems, available today, are typically limited to round-robin or time- 
slicing of the VMs, and do not provide the VMM to intelligently swap between the VMs 
using processor state information including characteristics and/or history of the 
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processor, characteristics and/or history of the guest software, characteristics and/or 
history of the VMs, and characteristics and/or history of the machine. 

One solution proposed by VMWare, Inc. (VMWare) of Palo Alto, California, 
relies on OS thread-scheduling to use the VMM to swap between the VMs. The 
5 VMWare solution provides for running two or more operating systems, such as Linux 
and Microsoft Windows, on a single machine, using the facilities provided by the 
operating system that runs on the underlying hardware. This system relies on the OS 
scheduling policy to schedule the VMs. However, virtualization based on OS scheduling 
(for scheduling the VMs) is performed without the knowledge of the processor state or 

10 even the processor. Furthermore, as the VM functionality moves into hardware, the OS- 
based solutions that attempt to optimize context-switch intervals for processors will likely 
be less aware or even completely unaware of the processors, the underlying system and 
its behaviour. Furthermore, the OS-based solutions not only do not accommodate 
characteristics of different processors, but also do not accommodate characteristics of 

1 5 processors of a single family. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Subject matter is particularly pointed out and distinctly claimed in the concluding 
20 portions of the specification. The disclosed subject matter, however, both as to 
organization and the method of operation, together with objects, features and advantages 
thereof, may be best understood by a reference to the following detailed description when 
read with the accompanying drawings in which: 
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FIG. 1 is a flowchart illustrating an embodiment of a technique for reallocating 
resources amongst virtual machine(s) in accordance with the disclosed subject matter; 
and 

FIG. 2 is a block diagram illustrating an embodiment of a system and apparatus 
5 that allows for management of virtual machine(s) using information regarding the activity 
of the virtual machine(s) in accordance with the disclosed subject matter. 



DETAILED DESCRIPTION 

10 In the following detailed description, numerous details are set forth in order to 

provide a thorough understanding of the present disclosed subject matter. However, it 
will be understood by those skilled in the art that the disclosed subject matter may be 
practiced without these specific details. In other instances, well-known methods, 
procedures, components, and circuits have not been described in detail so as to not 

1 5 obscure the disclosed subject matter. 

FIG. 1 is a flowchart illustrating an embodiment of a technique for reallocating 
resources amongst virtual machine(s) in accordance with the disclosed subject matter. 
Block 120 illustrates that the activity of the virtual machine (VM) may be monitored. In 
one embodiment, the virtual machine monitor (VMM) may monitor the VM. In one 

20 embodiment, activity such as, for example, processor usage, network usage, disk usage, 
or whether the VM is performing a time-critical task; however, these are merely a few 
non-limiting examples by which the disclosed subject matter is not limited. 
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In one embodiment, the activity may be monitored substantially in parallel with 
the execution of the VM. It is contemplated that the activity monitoring may be 
accomplished in hardware, software, firmware, or a combination thereof. In one 
embodiment, the activity may be monitored as the VM resource access is mapped to a 
5 real resource. In one embodiment, messages between the VM and the physical system 
may be caught and monitored by a virtual BIOS. In another embodiment, the messages 
between the VM and the physical system may be caught and monitored by a software 
application. In one embodiment, the VM activity may be monitored by a piece of logic in 
a processor core. Of course, these are merely a few illustrative examples to which the 

10 disclosed subject matter is not limited. 

Block 130 illustrates that the activity may then be evaluated. In one embodiment, 
the monitored activity may be compared against the standard usage model for a generic 
VM. In another embodiment, the monitored activity may be examined to determine if it 
includes any time critical elements. In one embodiment, the monitored activity may 

15 indicate that the virtual machine is heavily using some resources but not others. Of 
course, these are merely a few non-limiting examples of how the monitored activity may 
be evaluated by which the disclosed subject matter is not limited. 

Block 140 illustrates that it may be determined whether or not the activity of the 
VM triggers a change in the allocation of the resources used by the virtual machine. In 

20 one illustrative embodiment, a VM may be primarily using processor resources. For 
example the VM may be calculating data, or sorting lists. It may be determined that the 
amount of access the VM has to the processor is insufficient, and the VM would benefit 
from an increase to access to the physical processor. In a second illustrative embodiment, 
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the VM may still be primarily using processor resources, but an increase in access to the 
physical processor resource would not significantly increase the performance of the VM. 
In this embodiment, as illustrated by Block 1 10, the technique illustrated by Fig 1 may be 
performed on the next VM, or if only one VM is running in the system, repeated on the 
5 same VM. 

It is contemplated that, while the VM may have access to many resources, the 
number of resources that may be adjusted or reallocated to the VM may be less than the 
total resources available to the VM. For example, in one embodiment, only the amount 
of time the host system is able to execute the VM may be able to be reallocated. In other 

10 embodiments, access to particular resources, such as, for example, the processor, the 
network interface, the hard drive, may be reallocated. In another embodiment, the 
ordering, in the case where VMs are executed in a round-robin fashion, or priority of the 
VMs may be rearranged in order to improve the performance of one or more VMs. For 
example, if a VM enters a state where it must accomplish a tack immediately, such as, for 

1 5 example, reporting system status or bringing up a another VM, the VM may be moved 
out of its normal position in the round-robin scheme and set to execute as quickly as 
possible in order to properly accomplish its task. In yet another embodiment, block 140 
may reallocate or establish that, in a multi-processor, or multi-core environment, a certain 
VM has processor or core affinity with a particular processor or core, respectively. Some 

20 Operating System's have system calls for binding a process to a particular processor or 
core. The kernel ensures that when the process is re-scheduled it will be run on that 
processor/core and ideally, performance will be improved. It is contemplated that a 
particular embodiment may utilize one or more of these reallocation techniques described 
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above, and the techniques are not to be considered mutually exclusive. Furthermore, the 
disclosed subject matter is not limited to the few illustrative examples discussed above 
and other resource allocation techniques are contemplated and within the scope of the 
disclosed subject matter. 
5 Block 150 illustrates that, in one embodiment, if the determined resource 

reallocation would conflict with another virtual machine it may or may not be executed. 
For example, if two VMs are both network-bound, i.e. limited by amount of data it 
receives or transmits via the network, it may not be possible to reallocate enough 
resources to the first VM without decreasing the performance of the second VM. In one 

1 0 embodiment, illustrated by FIG. 1 , if the reallocation can not occur, no reallocation may 
be attempted and the technique may be repeated on the next virtual machine, as 
illustrated by Block 110. In another embodiment, a database detailing the resource needs 
of each VM may be kept. If the suggested resource allocation is not possible, a new 
resource allocation may be fashioned utilizing the database. However, these are merely 

1 5 two example embodiments and other embodiments are within the scope of the disclosed 
subject matter. 

Block 160 illustrates that the resources may be reallocated to the VM. In one 
specific embodiment, if a first VM is processor-bound and a second VM is network- 
bound, additional processor time or access may be allocated to the first VM and 
20 additional network interface time or access may be allocated to the second VM. 
Conversely, the processor time of the second VM may be decreased and the network 
interface access to the first VM may likewise be decreased. Of course, this is merely an 
illustrative example to which the disclosed matter is not limited. 
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In one embodiment, the technique of FIG. 1, in whole or part, may be executed on 
each VM in a serial fashion as illustrated by Block 110. In other embodiments, it is 
contemplated that the technique may be executed on each VM in parallel. It is further 
contemplated that some embodiments may execute a portion of the technique in parallel 
5 and a portion in serial. 

FIG. 2 is a block diagram illustrating an embodiment of a system 200 and 
apparatus 201 that allows for management of virtual machine(s) using information 
regarding the activity of the virtual machine(s) in accordance with the disclosed subject 
matter. In one embodiment, the apparatus may include a plurality of virtual machines 
10 210, 220 & 230, and activity monitor 240, a virtual machine monitor (VMM) 250, and a 
resource manager 260. It is understood that while three virtual machines are illustrated in 
FIG. 2 the apparatus may include any number of virtual machines. 

In one embodiment, the virtual machines 210, 220 & 230 may be capable of 
running an operating system 280 and a variety of applications 273, 276, & 279. It is 
15 contemplated that two or more virtual machines may share an operating system or 
applications. It is also contemplated that the virtual machines may also be capable of 
using a plurality of virtual resources that are mapped to physical resources. The activity 
monitor 240 may be capable of monitoring the activity of the virtual machines. In one 
embodiment, the activity monitor may be capable of performing a portion of the 
20 technique described above and illustrated by FIG. 1. It is contemplated that the activity 
monitor may be embodied in hardware, firmware, software, or a combination thereof. 

In one embodiment, the VMM 250 may be capable of mapping the virtual 
resources utilized by the plurality of virtual machines to physical resources. The VMM 
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may also be capable of managing the virtual machines access to the physical resources of 
the system. In one embodiment, the VMM may also include a resource manager 260 that 
is capable of reallocating the resources allotted to the virtual machines. In one 
embodiment, the resource manager may be capable of performing the technique 
5 described above and illustrated by FIG. 1 . It is contemplated that the activity monitor 
may be embodied in hardware, firmware, software, or a combination thereof. 

The system 200 may include the apparatus 201 and a plurality of physical 
resources 290. In one embodiment, the plurality of physical resources may include an 
input device 292, such as, for example, a mouse, a keyboard, a touchpad, etc., a display 

10 294, such as, for example, a cathode-ray-tube (CRT) or a liquid crystal display (LCD), a 
communication device 296, such as, for example, a network interface card or a modem, a 
memory element 298, and a processor 299. The plurality of virtual machines 210, 220, & 
230 may be capable of sharing the plurality of physical resources. This may be 
accomplished by creating a virtual plurality of resources in each VM, and mapping the 

1 5 virtual resources to the physical resources. 

The techniques described herein are not limited to any particular hardware or 
software configuration; they may find applicability in any computing or processing 
environment. The techniques may be implemented in hardware, software, firmware or a 
combination thereof. The techniques may be implemented in programs executing on 

20 programmable machines such as mobile or stationary computers, personal digital 
assistants, and similar devices that each include a processor, a storage medium readable 
or accessible by the processor (including volatile and non-volatile memory and/or storage 
elements), at least one input device, and one or more output devices. Program code is 
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applied to the data entered using the input device to perform the functions described and 
to generate output information. The output information may be applied to one or more 
output devices. 

Each program may be implemented in a high level procedural or object oriented 
5 programming language to communicate with a processing system. However, programs 
may be implemented in assembly or machine language, if desired. In any case, the 
language may be compiled or interpreted. 

Each such program may be stored on a storage medium or device, e.g. compact 
disk read only memory (CD-ROM), digital versatile disk (DVD), hard disk, firmware, 
1 0 non-volatile memory, magnetic disk or similar medium or device, that is readable by a 
general or special purpose programmable machine for configuring and operating the 
machine when the storage medium or device is read by the computer to perform the 
procedures described herein. The system may also be considered to be implemented as a 
machine-readable or accessible storage medium, configured with a program, where the 
15 storage medium so configured causes a machine to operate in a specific manner. Other 
embodiments are within the scope of the following claims. 

While certain features of the disclosed subject matter have been illustrated and 
described herein, many modifications, substitutions, changes, and equivalents will now 
occur to those skilled in the art. It is, therefore, to be understood that the appended 
20 claims are intended to cover all such modifications and changes that fall within the true 
spirit of the disclosed subject matter. 
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